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PROBLEM TO BE SOLVED: To increase the calculating speed of a 
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feature vector based on the mapping of the table 13 and outputs 
the calculated category set 



I 

I 



JL 



2 



--f it ? 



1 




LEGAL STATUS 

[Date of request for examination] 09.03.2004 

[Date of sending the examiners decision of rejection] 

[Kind of final disposal of application other than the 
examiner's decision of rejection or application converted 
registration] 

[Date of final disposal for application] 
[Patent number] 
[Date of registration] 

[Number of appeal against examiner's decision of 
rejection] 

[Date of requesting appeal against examiner's decision of 
rejection] 

[Date of extinction of right] 



http://www1 9.ipdl.ncipi.go jp/PA1 /result/detail/main/wAAA0baywzDA41 0289320... 2006/04/28 



\ / Searching PAJ 

ft 



2/2 ^— V 



Copyright (C); 1998.2003 Japan Patent Office 



http://vmw19jpdl.ncipi.gojp/PA1/result/detail/main/wAAA0baywzDA410289320... 2006/04/28 



y JP.10-289320.A [CLAIMS] 

f 

-.1 • 

* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original precisely. 
2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



1/3 v 



CLAIMS 
[Claim(s)] 

[Claim 1] The pattern-recognition equipment carry out having a candidate category count means asks for a table 
storage means memorize the candidate table which described information required in order to form the map which 
considers the value of the reference feature vector calculated from the feature vector of a pattern as an input, and 
considers a candidate category set as an output, and the candidate category set corresponding to the value of the 
reference feature vector given using said candidate table, and output the obtained candidate category set as the 
description. 

[Claim 2] Pattern recognition equipment according to claim 1 characterized by having further a reference feature- 
vector count means to calculate said reference feature vector from the feature vector of said pattern. 
[Claim 3] Said reference feature -vector count means is pattern recognition equipment according to claim 2 
characterized by outputting one or more partial feature vectors of the feature vector of said pattern as one or more 
reference feature vectors. 

[Claim 4] Said table storage means uses as the reference description division element each subset which divides or 
more into two the reference feature space which consists of the set of the value of said reference feature vector, 
and is obtained. This reference description division element and said candidate table including the information on the 
group of a candidate category set are held. Said candidate category count means Pattern recognition equipment 
according to claim 1 characterized by asking for the reference description division element including the value of 
said given reference feature vector, and asking for the candidate category set corresponding to the obtained 
reference description division element using said candidate table. 

[Claim 5] Said table storage means is pattern recognition equipment according to claim 4 characterized by holding 
the information on said reference description division element which divides said reference feature space in the 
shape of a grid, and is obtained. 

[Claim 6] Pattern recognition equipment according to claim 4 characterized by said table storage means holding the 
candidate table which presumed the projection range when projecting the set of the feature vector corresponding to 
each category to said reference feature space, and was created using the obtained estimate. 

[Claim 7] Said candidate table is pattern recognition equipment according to claim 6 characterized by creating the 
category corresponding to this estimate as an element of the candidate category set corresponding to this 
reference description division element when the intersection of said reference description division element and said 
estimate exists. 

[Claim 8] Said candidate table is pattern recognition equipment according to claim 6 which is calculating the 
minimum value and maximum of a value of a 1 -dimensional reference feature vector as estimate of the projection to 
the 1 -dimensional reference feature space corresponding to each category, and is characterized by being created. 
[Claim 9] Said candidate table is pattern recognition equipment according to claim 6 characterized by being created 
based on said estimate calculated using linear programming. 

[Claim 10] Said candidate table is pattern recognition equipment according to claim 6 characterized by being 
created based on said estimate calculated using nonlinear programming. 

[Claim 1 1] Said candidate table is pattern recognition equipment according to claim 6 characterized by being 
created based on said estimate calculated using distribution of the value of the reference feature vector obtained 
from the pattern set for study. 

[Claim 12] Said candidate table is pattern recognition equipment according to claim 6 characterized by being 
created based on said estimate which projects the BORONOI division element of the feature space based on the 
representation feature vector of each category registered into the dictionary to said reference feature space, and is 
obtained. 

[Claim 13] Pattern recognition equipment according to claim 1 characterized by having further a feature-extraction 
means to generate the feature vector of said pattern from an input configuration. 

[Claim 14] Pattern-recognition equipment according to claim 1 characterized by to have further a dictionary storage 
means memorize the specific-classification dictionary which registered the representation feature vector of each 
category, and a specific-classification means ask for the representation feature vector of each candidate category 
contained in said candidate category set using said specific classification dictionary, find the distance of the 
representation feature vector of this candidate category, and the feature vector of said pattern, and output the 
candidate category of a predetermined number to order with this small distance. 

[Claim 1 5] It is pattern-recognition equipment given in claim 1 term which performs conversion beforehand decided 
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to be the feature vector of said pattern, is further equipped with a description compression means generate a 
compression feature vector smaller than that of a number of dimension, and is characterized by for said candidate 
category count means to ask for said candidate category set using the value of said reference feature vector 
calculated from the value of the given compression feature vector. 

[Claim 16] Said candidate category count means is pattern recognition equipment according to claim 15 
characterized by using the partial feature vector of said compression feature vector as said reference feature 
vector. 

[Claim 17] A dictionary storage means to memorize the compression description dictionary which registered the 
compression feature vector of each category. It asks for the compression feature vector of each candidate category 
contained in said candidate category set using said compression description dictionary. Pattern recognition 
equipment according to claim 15 characterized by having further an Oita means to find the distance of the 
compression feature vector of this candidate category, and the compression feature vector outputted from said 
description compression means, and to output the candidate category of a predetermined number to order with this 
small distance. 

[Claim 18] Said Oita means is pattern recognition equipment according to claim 17 characterized by using one of 
Euclidean distance, city block distance, the Mahalanobis distance, false Mahalanobis distance, a BEIZU discriminant 
function, and false BEIZU discriminant functions as a definition of said distance. 

[Claim 19] Pattern-recognition equipment according to claim 17 characterized by to have further a dictionary 
storage means memorize the specific-classification dictionary which registered the representation feature vector of 
each category, and a specific-classification means ask for the representation feature vector of each candidate 
category outputted by said Oita means using said specific-classification dictionary, find the distance of the 
representation feature vector of this candidate category, and the feature vector of said pattern, and output the 
candidate category of a predetermined number to order with this small distance. 

[Claim 20] Said specific classification means is pattern recognition equipment according to claim 19 characterized 
by using one of Euclidean distance, city block distance, the Mahalanobis distance, false Mahalanobis distance, a 
BEIZU discriminant function, and false BEIZU discriminant functions as a definition of said distance. 
[Claim 21] Said description compression means is pattern recognition equipment according to claim 15 
characterized by generating said compression feature vector using linear transformation. 
[Claim 22] Said description compression means is pattern recognition equipment according to claim 21 
characterized by asking for said linear transformation by the principal component analysis of a feature space. 
[Claim 23] Said description compression means is pattern recognition equipment according to claim 21 
characterized by asking for said linear transformation by the canonical discriminant analysis of a feature space. 
[Claim 24] Said pattern is an alphabetic character, human being's face, a three-dimension body, and pattern 
recognition equipment according to claim 1 characterized by corresponding to at least one information among two- 
dimensional graphic forms. 

[Claim 25] Two or more table storage means to memorize the candidate table which described information required 
in order to form the map which considers the value of the reference feature vector calculated from the feature 
vector of a pattern as an input, and considers a candidate category set as an output, respectively. It is prepared 
corresponding to each of two or more of said table storage means, and said candidate table is used. Two or more 
candidate category count means to ask for the candidate category set corresponding to the value of the given 
reference feature vector, and to output the obtained candidate category set, respectively, Pattern recognition 
equipment characterized by having a category narrowing-down means to narrow down and output two or more 
candidate category sets outputted from said two or more candidate category count means. 
[Claim 26] Said category narrowing-down means is pattern recognition equipment according to claim 25 
characterized by calculating the AND of two or more candidate category sets, and narrowing down these two or 
more candidate category sets. 

[Claim 27] Pattern recognition equipment characterized by having a candidate category count means to ask for a 
storage means to memorize the correspondence relation between the characteristic quantity data showing the 
description of a pattern, and a candidate category set, and the candidate category set corresponding to the 
characteristic quantity data given using said correspondence relation, and to output the obtained candidate category 
set 

[Claim 28] Are the record medium which recorded the program for a computer, and the value of the reference 
feature vector calculated from the feature vector of a pattern is considered as an input. The function to ask for the 
candidate category set corresponding to the value of the given reference feature vector using the candidate table 
which described information required in order to form the map which considers a candidate category set as an 
output. The record medium which recorded the program for making said computer realize the function which outputs 
the obtained candidate category set and in which computer reading is possible. 

[Claim 29] The record medium which recorded the program for making said computer realize the function ask for the 
candidate category set corresponding to the given characteristic-quantity data, and the function which outputs the 
obtained candidate category set using the correspondence relation between the characteristic-quantity data which 
are the record medium which recorded the program for a computer, and express the description of a pattern, and a 
candidate category set and in which computer reading is possible. 

[Claim 30] The pattern recognition approach characterized by asking for the candidate category set corresponding 
to the value of the given reference feature vector, and outputting the obtained candidate category set using the 
candidate table which described information required in order to form the map which considers the value of the 
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reference feature vector calculated from the feature vector of a pattern as an input, and considers a candidate 
category set as an output 

[Claim 31] The pattern recognition approach characterized by asking for the candidate category set corresponding 
to the given characteristic quantity data, and outputting the obtained candidate category set using the 
correspondence relation between the characteristic quantity data showing the description of a pattern, and a 
candidate category set. 

[Translation done.] 
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[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to pattern recognition and relates to the pattern recognition 
equipment which presumes the category to which an input configuration or its feature vector belongs, and 
recognizes a pattern, and its approach. 
[0002] 

[Description of the Prior Art] In recent years, the document recognition equipment which a document is 
electronically filed for the increase in efficiency of the workflow in office, and the system coded if needed is being 
developed, therefore recognizes a FAX document etc. is called for strongly. Especially the character reader is 
indispensable because of coding of character string information, and for the utilization and far-reaching spread, it 
becomes important more to presume an alphabetic character category at a high speed, with a high recognition 
precision maintained. 

[0003] Moreover, the recognition technique of human beings face is becoming important as a technical element of a 
teleconference and a security system, and the high speed and the highly precise face recognition technique which 
can perform identification of human being's face on real time are searched for. 

[0004] Moreover, with the spread of computer graphics, CAD (computer aided design), DTP (desk top publishing), 
etc., the recognition technique of a three-dimension body or a two-dimensional graphic form inputs efficiently into a 
computer the three-dimension body or two-dimensional graphic form which exists actually, and is becoming 
important as a means for reusing. Therefore, the recognition technique of a high speed and a highly precise body, or 
a graphic form turns into a technique practically indispensable for these systems. 

[0005] Thus, a high speed and highly precise pattern recognition have played the important role as a technical 
element when building various kinds of practical pattern recognition equipments. Here, the vocabulary which may set 
to pattern recognition and is used is defined briefly. 

[0006] The thing of the set from which a pattern, and a call and all patterns make the thing for recognition is called 
a pattern space. The number of the elements of a feature vector, and a call and a feature vector is called the 
dimension of a feature vector for the group of one or more characteristic quantity obtained by carrying out the 
feature extraction of the pattern. 

[0007] The thing of the set from which the value of a feature vector, and a call and the value of all feature vectors 
make the group of the value of each element of a feature vector is called a feature space. The dimension of a 
feature space is equal to the dimension of the feature vector which is the element of a feature space. 
[0008] The group of the value of each element of a partial feature vector, and a call and a partial feature vector is 
called the value of a partial feature vector for the subset of the element of a feature vector. The thing of the set 
which the value of all partial feature vectors makes is called a partial feature space. The dimension of a partial 
feature space is equal to the dimension of the partial feature vector which is the element of a partial feature space. 
[0009] The set of the pattern or feature vector it can be considered that is the same class is called a category. The 
set of the feature vector which can consider that the sets of the pattern it can be considered especially that is the 
same class are a category pattern set and the same class is called the category description set. 
[0010] It calls it pattern recognition to determine to which category (a category pattern set or the category 
description set) the inputted pattern or ****** KUTORU belongs. When the pattern or feature vector inputted 
especially is presumed to belong to a certain category in a category set, the category set is called a candidate 
category set. 

[001 1] Before, there is the approach of shortening the processing time sharply by performing the description 
compression and reducing greatly the number of dimension of the feature vector used for the distance count at the 
time of collating as the high-speed pattern recognition approach. Drawing 23 is the block diagram of the pattern 
recognition equipment using the high-speed classification by such description compression. 
[0012] In the pattern recognition equipment of drawing 23 . the feature-extraction section 1 extracts a feature 
vector from an input configuration, the description compression zone 2 performs line type conversion of a feature 
vector, and it asks for the lower compression feature vector of a number of dimension. The compression feature 
vector corresponding to each category is held, and the kind section 3 asks the compression description dictionary 4 
for the distance of the compression feature vector for which the description compression zone 2 asked, and each 
compression feature vector in the compression description dictionary 4 very much. And a category is rearranged 
into order with a small distance, and the train of a number of categories specified from the thing of the minimum 
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distance is outputted as a candidate category set. 
[0013] 

[Problem(s) to be Solved by the Invention] However, there are the following problems in the conventional pattern 
recognition. In the pattern recognition using the high-speed classification by the description compression, when 
compressing a feature vector and changing into the low compression feature vector of a dimension more, 
informational lack occurs. For this reason, the category containing a compression feature vector with a small 
distance with the compression feature vector of an input configuration does not necessarily restrict that the former 
is included, and a right candidate category set may not be obtained, therefore — low — to a quality input 
configuration, recognition precision falls sharply and there is a problem that recognition precision falls a little, also to 
a quality input configuration. 

[0014] The technical problem of this invention is offering the pattern recognition equipment which can accelerate 

calculation of a candidate category set, and its approach, suppressing the fall of recognition precision. 

[0015] 

[Means for Solving the Problem] Drawing 1 is the principle Fig. of the pattern recognition equipment of this 
invention. The pattern recognition equipment of drawing 1 is equipped with the table storage means 1 1 and the 
candidate category count means 12. 

[0016] The table storage means 11 memorizes the candidate table 13 which described information required in order 
to form the map which considers the value of the reference feature vector calculated from the feature vector of a 
pattern as an input, and considers a candidate category set as an output. 

[0017] Using the candidate table 13. the candidate category count means 12 asks for the candidate category set 
corresponding to the value of the given reference feature vector, and outputs the obtained candidate category set. 
[0018] A reference feature vector is a feature vector which the candidate category count means 12 refers to, and 
the thing of the set of the dimension of a reference feature vector and the value of a call and a reference feature 
vector by the number of the elements of a reference feature vector is called a reference feature space. The 
dimension of a reference feature space is equal to the dimension of the reference feature vector which is the 
element of a reference feature space. For example, the partial feature vector which consists of some elements of a 
feature vector is used as a reference feature vector. 

[0019] The candidate table 13 holds the map information showing each value of a reference feature vector, and the 
correspondence relation of a candidate category set. Therefore, if this candidate table 13 is referred to, it can ask 
for the candidate category set corresponding to the value of a specific reference feature vector immediately. When 
the value of a reference feature vector is able to be given, the candidate category count means 12 inputs the value 
into the map of the candidate table 13, asks for a corresponding candidate category set, and outputs it. 
[0020] in such pattern recognition equipment, without performing distance count between complicated feature 
vectors, a candidate category set can be outputted only by actuation of easy table length, and pattern recognition 
processing is markedly alike and is accelerated. Moreover, it is possible to maintain a recognition precision 
comparable as the case where this invention is not used, by setting up the map of the candidate table 13 
appropriately. 

[0021] For example, the table storage means 1 1 of drawing 1 corresponds to the memory 32 of drawing 4 mentioned 
later, and the candidate category count means 12 corresponds to CPU (central processing unit)31 and memory 32. 
[0022] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained to a detail, referring 
to a drawing. In this invention, the candidate category count section which outputs a candidate category set is 
prepared, without performing distance count between feature vectors by referring to the candidate table prepared 
beforehand. Information required for a candidate table since the map which considers the value of a certain 
reference feature vector calculated from a feature vector as an input, and considers a certain candidate category 
set as an output is constituted is described. 

[0023] Based on the value of the inputted reference feature vector, the candidate category count section asks for a 
candidate category set from a candidate table, and outputs it maintaining a precision almost comparable as the 
case where the high-speed classification technique of this invention is not used, if the thing suitable, as the value of 
a reference feature vector and a map of a category set for a candidate table is held, it can be markedly alike and a 
high-speed classification can be realized. 

[0024] Drawing 2 shows the example of the record of a candidate table. The reference description division element x 
of drawing 2 expresses the range of the specific value of a reference feature vector, or a value, and corresponds to 
the specific point or specific field in a reference feature space. When the value of the reference feature vector 
given to the candidate category count section is included in the reference description division element x, a 
corresponding candidate category set (B, C. G. H, K) is outputted as a classification result 

[0025] Drawing 3 shows the relation between a category and a reference feature space. In the creation time of a 
candidate table, the reference feature space 22 is divided into two or more reference description division elements 
in accordance with suitable criteria, and the projection (the reference description projection) from each categories 
A. B, C, D, E, F, G, H, I, J, K, L, and M corresponding to a feature space 21 to the reference feature space 22 is 
presumed. And for example, to each reference description division element, it asks for the intersection of the field 
and reference description projection of each category, and the set of the category in which an intersection exists is 
considered as a corresponding candidate category set. 

[0026] Here, since the projection of Categories B. C. G. H. and K has the reference description division element x 
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and an intersection, the set (B f C. G, H. K) which makes these an element turns into a candidate category set 
corresponding to the reference description division element x. as shown in drawing 2 . The candidate category set 
corresponding to other reference description division elements y is called for similarly. 

[0027] Thus, the category in which the reference description projection has the reference description division 
element and an intersection is used as the element of a candidate category set, and the group of the reference 
description division element and a candidate category set is held as a candidate table. And the candidate category 
count section asks for the reference description division element including the value of the given reference feature 
vector, and asks for the candidate category set which corresponds using a candidate table. Thereby, a high-speed 
classification can be realized, without reducing precision. 

[0028] Drawing 4 is the block diagram of the information processor (computer) used for such pattern recognition 
equipment The information processor of drawing 4 is equipped with CPU (central processing un'rt)31, memory 32, an 
input unit 33, an output unit 34, external storage 35, the medium driving gear 36, network connection equipment 37, 
and photo-electric-conversion equipment 38. and each of those equipments of each other are combined by bus 39. 
[0029] CPU31 realizes processing of pattern recognition equipment using the program and candidate table which 
were stored in memory 32. The program and data which are used for processing are stored in memory 32. This 
memory 32 contains ROM (read onlymemory). RAM (random access memory), etc. 

[0030] An input device 33 is equivalent to a keyboard, a pointing device, etc., and is used for the input of the 
demand from a user, or directions. Moreover, an output unit 34 is equivalent to a display, a printer, etc., and is used 
for outputs, such as an inquiry to a user, and a processing result 

[0031] External storage 35 is a magnetic disk drive, an optical disk unit optical-magnetic disc equipment, etc. An 
above-mentioned program and data are saved at this external storage 35, and it can be used if needed, being able to 
load them to memory 32. Moreover, external storage 35 is used also as a database which saves a pattern, a feature 
vector, a candidate table, etc. 

[0032] The medium driving gear 36 drives the portable record medium 40, and can access the contents of storage. 
As a portable record medium 40. a memory card, a floppy disk. CD-ROM (compact disk read only memory), an 
optical disk, a magneto-optic disk, etc. can use the record medium which arbitration can computer read. An above- 
mentioned program and data are stored in this portable record medium 40, and it can be used if needed, being able 
to load them to memory 32. 

[0033] Network connection equipment 37 is connected to the communication network of arbitration, such as LAN 
(local area network), and data conversion accompanying a communication link etc. is performed. Pattern recognition 
equipment communicates with an external information provider s equipment 40' (database etc.) through network 
connection equipment 37. Thereby, an above-mentioned program and data can be used for memory 32 for reception 
and them through a network if needed from equipment 40\ loading. Photo-electric-conversion equipment 38 is an 
image scanner, and is used for the input of the pattern used as a processing object 

[0034] Next, the example of a reference feature vector and a candidate table and the functional configuration of 
pattern recognition equipment are explained, referring to from drawing 5 to drawing 14 . Drawing 5 shows the 
structure of the candidate table used with this operation gestalt. The group of two or more reference description 
division elements and a candidate category set is stored in the candidate table of drawing 5 , and it is used for the 
classification of a reference feature vector. 

[0035] Drawing 6 is the block diagram of the 1st pattern recognition equipment which has the candidate table which 
performs a high-speed classification using the partial feature vector of the inputted feature vector. The pattern 
recognition equipment of drawing 6 is equipped with the value of the reference feature vector calculated from a 
feature vector, the candidate table 41 holding the group of a category set and the candidate category count section 
42. 

[0036] The candidate category count section 42 asks for a candidate category set using the value and the 
candidate table 41 of the reference feature vector by making a partial feature vector with the inputted feature 
vector into a reference feature vector, and outputs it 

[0037] Here, the feature space which a feature vector accomplishes is K category description sets (category) C1 
which do not cross mutually, and C2, .... CK. Suppose that it is covered. At this time, it is CSET about the set of all 
category description sets. When it carries out, it is CSET = (C1, and {C2 CK}). 

It can write. Moreover, when the number of dimension of a feature space is set to N, the element is used for 
feature-vector f, and it is f= (f1, and f2 fN). 

It can write. At this time, the candidate category count section 42 is category CIN**CSET to which the input 

feature vector fIN belongs. The candidate category set CCAND to include is presumed and it is outputted. As a 

reference feature vector, the partial feature vector of the arbitration of a feature vector can be used. 

[0038] For example, when two-dimensional partial feature-vector g= (f1 and f2) is made into a reference feature 

vector, the candidate table 41 is constituted by the value of a two-dimensional partial feature vector, and the group 

of a candidate category set And all the values that a two-dimensional partial feature vector can take are registered 

into a candidate table. Here, when each element of feature-vector f shall take either of three kinds of values 0. 1. 

and 2, respectively, the candidate table 41 is as follows. 

((0,0).C(0 ) ) 

((0.1),C(0)) 

«0.2).C(0 ) ) 

((1.0).C(1 )) 
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((1.1XC(1 )) * 

(0.2),C(1 )) 
«2,0XC(2 ) ) 
«2,1XC(2)) 
«2.2),C(2 ) ) 

Here, it is C(p) **CSET. It is the candidate category set corresponding to the value (p= 0, 1, 2; q= 0. 1, 2) (p, q) of a 
reference feature vector. In this case, the point (p. q) in a reference feature space serves as the reference 
description division element. 

[0039] The candidate category count section 42 calculates the value (p. q) of a two-dimensional reference feature 
vector from the inputted feature vector, and it asks for the group which has (p. q) in a left element out of the 
candidate table 41, and is the candidate category set C of the right element (p). It outputs. 

[0040] If such pattern recognition equipment is used, a high speed can be asked for a candidate category set with 
table length, without performing distance count. Moreover, if the candidate category set currently held on the 
candidate table 41 is appropriate respectively, highly precise and the pattern recognition equipment which performs 
pattern recognition at a high speed are realizable. 

[0041] Drawing 7 is the block diagram of the 2nd pattern recognition equipment which asks for a feature vector from 
the inputted pattern, and performs the high-speed classification using a candidate table by making the partial 
feature vector of a feature vector into a reference feature vector. 

[0042] The pattern recognition equipment of drawing 7 is equipped with the feature-extraction section 51 which 
extracts a feature vector from the inputted character pattern, the candidate category count section 52, and the 
candidate table 53. The candidate table 53 is created for example, using the character-pattern set for study. 
[0043] The feature space which the feature vector which K categories of a character pattern shall have and 

corresponds accomplishes here is K category description sets CI which do not cross mutually, and C2 CK. 

Suppose that it is covered. At this time, it is the set CSET of all category description sets. CSET = (C1, and {C2 

CK}) 

It can write. The candidate category count section 52 is category C1N**CSET to which the input-statement 
character pattern PIN belongs. The candidate category set CCAND to include is presumed and it is outputted. 
[0044] First, the feature-extraction processing by the feature-extraction section 51 is explained. There is direction 
stroke characteristic quantity as characteristic quantity well used for the feature extraction from the character 
pattern. This divides a character pattern in the shape of [ two-dimensional ] a grid, counts the number of the profile 
direction components of the character pattern in each grid, and makes it characteristic quantity. 
[0045] For example, when the grid beside [ 7 ] vertical 7x is used, the number of grid becomes a total of 49 pieces. 
If the profile direction component is roughly made into the four directions of width, length, right slant, and left slant, 
49x4=196 piece characteristic quantity can be obtained. By this, a 196-dimensional feature vector will be extracted 
from the inputted character pattern. 

[0046] Generally, when the number of dimension of a feature space is set to N. the element is used for feature- 
vector f, and it is f= (fl, and f2 fN). 

It can write. The value of each element of feature-vector f supports the number of the pixels which have a specific 
direction component among the profile pixels contained in a specific grid, for example, is expressed with zero or 
more integral values. 

[0047] Furthermore, one element f1 of a feature vector If it is referred to as 1 -dimensional reference feature- 
vector r and the range of the value which a reference feature vector can take is made into A<=r<B, section [A and 
B will become a reference feature space. 

[0048] As a reference description division element used as the element of a candidate table, what divided reference 
feature-space [A and B in the shape of a grid will be used, in this case — since a reference feature space is one 
dimension — section [ — A and B — A=s -1 — < — sO — < — s1 — < — s2 — < ... < — if it divides into L+1 

section Ri =[si-1 and si (i= 0, 1 L) like sL =B, each section Ri will serve as the reference description division 

element. What is necessary is just to consider as A=-infinity and B=+infinity, when defining a reference feature 
space as infinity space. 

[0049] For example, in the case of the 1-dimensional reference feature space 55 shown in drawing 8 As L= 6, R0= 
(-infinity and s0), R1 =[s0, and s1, It is divided into seven reference description division elements of R2 =[s1, s2, R3 
=[s2, s3. R4 =[s3, s4, R5 =[s4, s5, R6 =[s5, and +inflnity. 

[0050] Each reference description division element Ri The receiving candidate category set is called for by 
presuming the reference description projection over each alphabetic character category of the character-pattern 
set for study. And the candidate table 53 is created using those candidate category sets. 

[0051] However, only sufficient number shall contain the character pattern to which the character-pattern set for 
study belongs to each alphabetic character category. Specific alphabetic character category Ck Receiving 
presumption of the reference description projection is performed as follows. 

[0052] First, the character-pattern set for study to alphabetic character category Ck The character pattern which 
belongs is taken out, and the feature extraction of each character pattern is carried out, and it asks for a 
corresponding feature vector. Next, set Fk of the 1st element fl of the set of the obtained feature vector to each 
feature vector It is Set Fk if it asks. Alphabetic character category Ck The distribution which approximates the 
reference description projection is formed. This set Fk The minimum value MINk of an element Maximum MAXk It 
asks, the further specific margin M is taken into consideration, and it is the alphabetic character category Ck. 
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Estimate Qk of the reference description projection Qk = [MINk-M. MAXk+M] 
** — it can consider as a closed interval [ like ]. 

[0053] the reference description division element Ri for which it asked as mentioned above Each alphabetic 
character category Ck The receiving reference description projection Qk from — each reference description 
division element Ri Candidate category set Di which should be made into a group It asks. 
[0054] here — a certain reference description division element Ri The reference description projection Qk 
Alphabetic character category [ like ] Ck with an intersection (a product set is not empty class) a set — the 
reference description division element Ri Receiving candidate category set Di ** — it will carry out Thereby, it is 
the candidate category set Di. The reference description division element Ri It becomes what enumerated the 
alphabetic character categories to which a character pattern with the value of the reference feature vector which 
belongs may belong. 

[0055] Therefore, candidate category set Di containing the alphabetic character category which is enough in order 
to maintain recognition precision It is obtained and the candidate table 53 is the reference description division 
element Ri. Candidate category set Di It is constituted by the group. 

[0056] It sets to the feature space 54 of drawing 8 , and the projection of Categories B, C, G, H, and K is the 
reference description division element R3. The set (B, C, G, H, K) which makes these an element since it has an 
intersection is the reference description division element R3. It becomes a corresponding candidate category set. 
The candidate category set corresponding to other reference description division elements is called for similarly, and 
the candidate table 53 comes to be shown in drawing 9 . 

[0057] The candidate category count section 52 is the reference description division element Ri with which this is 
made into the value of a reference feature vector, and this value r belongs first when the value of the 1st inputted 
element of a feature vector is r. It asks. Here, it is the reference description division element Ri. Since it is the 1- 
dimensional section, it is easy to judge to which section a value r belongs. Next, the candidate table 53 is used and 
it is the reference description division element Ri. It asks for the corresponding candidate category Di, and this is 
outputted as a character recognition result. It is expectable that the alphabetic character category to which an 
input-statement character pattern belongs belongs in the outputted candidate category set. 

[0058] If such pattern recognition equipment is used, it can ask without reducing precision with table length very at 
high speed [ without performing distance count / an input-statement character pattern / category / a group, then / 
which can be presumed / candidate ]. 

[0059] Drawing 10 is the block diagram of the 3rd pattern recognition equipment which asks for a feature vector 
from the inputted character pattern, and performs the detailed high-speed classification using a candidate table by 
making the partial feature vector of a feature vector into a reference feature vector. 

[0060] The pattern recognition equipment of drawing 10 is equipped with the dictionary 65 for the feature- 
extraction section 61, the candidate category count section 62, the specific classification section 63, the candidate 
table 64, and specific classification. The feature-extraction section 61 extracts a feature vector from the inputted 
character pattern. 

[0061] The BORONOI (1 outside ) division which the representation feature vector to each alphabetic character 
category registered into the dictionary 65 makes here in order to create the candidate table 64 is used, and it is 
[0062]. 

[External Character 1] 

VoronoY 

[0063] **. BORONOI division is a kind of the field defined based on the distance from those points when two or 
more points are given into the space of arbitration, and it is also called a BORONOI field. 

[0064] the set CSET of the category description set, feature-vector f, a reference feature space, and the reference 
description division element Ri etc. — about the contents of a notation and feature -extract! on processing, it is the 
same as that of the case of the 2nd pattern recognition equipment. The candidate category count section 62 is 
category CIN**CSET to which the input-statement character pattern PIN belongs. The candidate category set 
CCAND to include is presumed and it is outputted. 

[0065] The specific classification section 63 performs distance count using a dictionary 65 by considering the 
candidate category which the candidate category count section 62 outputted as an input. The dictionary 65 holds 
the representation feature vector to each alphabetic character category, and the specific classification section 63 
asks for a representation feature vector [ as / whose distance from the feature vector corresponding to an input- 
statement character pattern is min ], and outputs the alphabetic character category corresponding to it as a 
presumed alphabetic character category. 

[0066] Here, it is each alphabetic character category Ck. Estimate Qk of the receiving reference description 
projection Each alphabetic character category Cj which does not ask using the character-pattern set for study, but 
is registered into the dictionary 65 for specific classification Receiving representation feature vector Ej BORONOI 
division Vk obtained from a set It uses and asks. 

[0067] Here, it is the alphabetic character category Ck. Receiving BORONOI division Vk When the distance of 
feature-vector f of arbitration and all the representation feature vectors registered into the dictionary 65 is found in 
a feature space, it is the alphabetic character category Ck. Receiving representation feature vector Ek It is the 
thing of a set of feature-vector f from which distance serves as min. If the specific classification based on distance 
count divides a feature space, it is known that BORONOI division will be obtained. 

[0068] For example, it sets to a two-dimensional feature space, and is a category CI, C2, C3, C4, and C5 and C6. 
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The receiving representation feature vector E1, E2, E3, E4, E5. and E6 When given. The corresponding BORONOI 
division VI, V2, V3, V4, V5, and V6 It comes to be shown in drawing 1 1 . drawing 1 1 — setting — BORONOI division 
V3 BORONOI division V5 feature- vector f= on a boundary (fl and f2) — representation feature vector E3 E5 from - 

- it is in an equidistant location. The same is said of the point on other boundaries. 

[0069] When BORONOI division generally becomes the super-convex polyhedron surrounded in the hyperplane in a 
feature space in the feature space of N dimension when Euclidean distance is used, and street division distance 
(city block distance) is used, BORONOI division serves as a super-polyhedron, moreover, when a nonlinear distance 
like the Mahalanobis (Mahalanobis) distance was used, BORONOI division was surrounded in hypersurface — an 
owner — it becomes a **** subset. 

[0070] Here, the hypersurface of N dimension space means an N-1 -dimensional curved surface, and a hyperplane 
means that case of being special. About a definition and semantics of distance with various city block distance etc., 
it will mention later. One element fl of feature-vector f If it is a reference feature vector, "it is the BORONOI 
division Vk into a reference feature space. Estimate Qk of the reference description projection BORONOI division 
Vk Element fl of featu re- vector f which belongs It is given as range of a value. When distance is Euclidean distance, 
it is the BORONOI division Vk by the linear programming. The minimum value and maximum of a reference feature 
vector can be calculated, and it is the estimate Qk of those values to the reference description projection. It is 
obtained. 

[0071] moreover — if the 1 -dimensional reference feature vector is used also in the case of more general distance 

— nonlinear programming — BORONOI division Vk from — estimate Qk of the reference description projection It 
can ask. About the presumed approach of the reference description projection by the linear programming and 
nonlinear programming, it will mention later. 

[0072] The reference description division element Ri for which it asked as mentioned above Each alphabetic 
character category Ck The receiving reference description projection Qk It uses and is each reference description 
division element Ri. Candidate category set Di which should be made a group It asks. 

[0073] For example, it is the reference description division element Ri like the case of the 2nd pattern recognition 
equipment The reference description projection Qk Alphabetic character category Ck which has an intersection 
Candidate category set Di of as opposed to the reference description division element Ri for a set Then, it is good. 
Thereby, it is the candidate category set Di. The reference description division element Ri It becomes what 
enumerated the alphabetic character categories to which a character pattern with the value of the reference 
feature vector which belongs may belong. 

[0074] Drawing 12 shows BORONOI division of a category, and the relation of a two-dimensional reference feature 
space. In the feature space 71 of drawing 1 2 , the projection field of each BORONOI division in the reference 
feature space 72 is obtained by projecting the BORONOI division A, B. C, D. E, F, G. H. I. J. K, L, and M to each 
category to the reference feature space 72. This field serves as estimate of the reference description projection. 
[0075] And to each reference description division element, it asks for the intersection of the field and reference 
description projection of each category, and the set of the category in which an intersection exists is considered as 
a corresponding candidate category set. 

[0076] Here, since the projection of Categories B, C, G, H, and K has the reference description division element x 
and an intersection, the set (B, C, G, H, K) which makes these an element turns into a candidate category set 
corresponding to the reference description division element x like the record of drawing 2 . The candidate category 
set corresponding to other reference description division elements y is called for similarly. 
[0077] The candidate table 64 is the reference description division element Ri. Candidate category set Di 
Constituted by the group, the candidate category count section 62 asks for a candidate category set from the 
inputted feature vector like the case of the 2nd pattern recognition equipment using the candidate table 64, and 
passes it to the specific classification section 63. 

[0078] The specific classification section 63 takes out the representation feature vector of each alphabetic 
character category belonging to the candidate category set narrowed down by the candidate category count section 
62 with reference to a dictionary 65. And distance with the feature vector to the character pattern inputted as each 
of those representation feature vectors is calculated, and an alphabetic character category from which distance 
serves as min is outputted as a presumed alphabetic character category. 

[0079] Thus, the reference description projection of the BORONOI division to each alphabetic character category 
used by specific classification can be searched for, and it can ask for the candidate category set which consists of 
the need and sufficient alphabetic character category for specific classification by making the alphabetic character 
category corresponding to the reference description projection with the reference description division element and 
an intersection into a candidate category. 

[0080] Thereby, guaranteeing the precision of specific classification for a group, then the candidate category which 
can be presumed, it can narrow down to a high speed very much with table length, and an input-statement 
character pattern can reduce the object alphabetic character categories of specific classification sharply. Therefore, 
highly precise and the pattern recognition equipment which performs pattern recognition at a high speed are 
realized. Next, in the pattern recognition equipment of drawing 10 R> 0, the case where two elements (fl and f2) of 
feature-vector f are set to two-dimensional reference feature-vector r is considered. If the range of the value 
which each element of reference feature-vector r can take is made into fl **[A1, B1. f2 **[A2, and B-2, rectangle 
field [A1. B1 x[A2. and B-2 will serve as a reference feature space. 

[0081] As a reference description division element used as the element of the candidate table 64, what divided 
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reference feature-space [A1, B1 x[A2, and B-2 in the shape of a grid is used. For this reason, as shown below, 
section [A1 and B1 are divided at the L1+1 piece section, and section [A2 and B-2 are divided at the L2+1 piece 
section. 

A1 =s-1 — < — sO — < — si — < — s2 — <...< — sL1=B1A2 =t-1 — < — tO — < — tl — < — t2 — < .... if 
the <tl_2=B-2 indexes i and j are used The reference description division element R (i) R (i) = rectangle [si— 1. si xftj- 
1, and ti 

** — it defines like, here — i= — 0, 1 L1, and j= — 0, 1 L2 it is . Thereby, it is the reference description 

division element R (i). It becomes a two-dimensional rectangle field. For example, in the case of the two-dimensional 
reference feature space 74 shown in drawin g 13 , it is divided into the x(5+1) (3+1) =24 piece reference description 
division element as L1 =5 and L2=3. 

[0082] next, each alphabetic character category Ck Receiving BORONOI division Vk all the feature vectors that 
belong — taking out — the range of the value of those reference feature vectors (f 1 and f2) — estimate Qk of the 
reference description projection ** — it carries out. And the reference description division element R (i) The 
reference description projection Qk Alphabetic character category Ck which has an intersection About a set, it is 
the reference description division element R (i). The receiving candidate category set D (i) It carries out. 
[0083] In this case, the candidate table 64 is the reference description division element R (i). Candidate category 
set D (i) It is constituted by the group. It is as having mentioned above about processing of the feature-extraction 
section 61 and the specific classification section 63. 

[0084] In the feature space 73 of drawing 13 , since the projection of Categories B, C, and K has reference 
description division element X=[s2, s3 x[t0, t1, and an intersection, the set (B, C, K) which makes these an element 
turns into a candidate category set corresponding to the reference description division element X. Moreover, since 
the projection of Categories G, H, and K has reference description division element Y=[s2, s3 x[t1, t2, and an 
intersection, the set (G, H, K) which makes these an element turns into a candidate category set corresponding to 
the reference description division element Y. Therefore, the candidate table 64 comes to be shown in drawing 14 . 
[0085] the value of the 1st element of a feature vector into which the candidate category count section 62 was 
inputted, and the 2nd element — respectively — r1 and r2 it is — a case — r= (r1 and r2) — the reference 
description division element R of a reference feature vector with which it considers as a value and this value 
belongs first (i) It asks. The reference description division element R (i) Since it is a two-dimensional rectangle field, 
it is easy to judge to which field a value r belongs. Next, the candidate table 64 is used and it is the reference 
description division element R (i). Corresponding candidate category set D (i) It asks and it is passed to the specific 
classification section 63. 

[0086] Thus, it is possible for a reference feature space not to be restricted to 1 -dimensional space, but to set it as 
the space of the dimension of arbitration generally. Here, the creation approach of a candidate table in case a 
reference feature space is more than two-dimensional is packed. Although the following examples are the cases 
where a reference feature space is two-dimensional, in beyond a three dimension, a candidate table can be created 
similarly. 

[0087] First, a reference feature space is divided in a straight line perpendicular to each axis of coordinates, it 
divides in the shape of a grid, and the case where each grid (grid) is used as the reference description division 
element is considered. In this case, the grid which corresponds considering the two-dimensional index of each grid 
as (i, j) will be expressed with K (i, j). When the projection to the reference feature space of Category C has Grid K 
(i, j) and an intersection, let Category C be the element of the candidate category set S (i, j) to Grid K (i, j). 
[0088] In this way. each grid K of a reference feature space (i. j) and the group of the candidate category set S (i, j) 
which were made are expressed using the index (i, j) of a grid, and the index of each category belonging to a 
candidate category set, and it holds as a candidate table. 

[0089] Next, the case where carry out BORONOI division of the reference feature space using a quantizing point, 
and each BORONOI field is used as the reference description division element is considered. In this case, each 
quantizing point will be expressed with (xi and yi). using as i the index of the quantizing point of representing each 
BORONOI field of a reference feature space. The projection to the reference feature space of Category C is the 
BORONOI field Vi of a quantizing point (xi, yi). When it has an intersection, it is the BORONOI field Vi about 
Category C. It considers as the element of receiving candidate category set S (i). 

[0090] In this way. each BORONOI field Vi of the made reference feature space About the group of candidate 
category set S (i), it is the BORONOI field Vi. It expresses using the index of the quantizing point to represent, and 
the index of each category belonging to a candidate category set, and holds as a candidate table. 
[0091] In these examples, there are two approaches mentioned above, for example as an approach of searching for 
the projection to the reference feature space of a certain category. One is the approach of presuming the reference 
description projection by projecting the feature vector corresponding to the pattern set for study (training pattern) 
on a reference feature space, respectively, and another is the approach of presuming the reference description 
projection based on the BORONOI division using the representation feature vector registered into the dictionary at 
the time of specific classification. 

[0092] Here, the flow of the candidate table creation processing using each of these presumed approaches is 
explained, referring to from drawin g 1 5 to drawin g 19 . Drawin g 15 is the flow chart of candidate table creation 
processing in which the training pattern was used. Although the flow chart of drawing 15 R> 5 is described about the 
case of a 1 -dimensional reference feature space, it is more the same also about the case of the reference feature 
space of high order origin. 
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[0093] reference description division element Ri =[sM [ in / first / in pattern recognition equipment / a reference 

feature space ] when processing is started, and si — i= — it asks about 0, 1 L (step SI). Next, it asks for 

estimate Qk = [MINk and MAXk] of the reference description projection to each category Ck (k= 1 K) using the 

projection to the reference feature space of a training pattern (step S2). 

[0094] Next, each reference description division element Ri Receiving candidate category set Di It asks from 

estimate Qk (k= 1 K) (step S3). And each reference description division element Ri Candidate category set Di A 

group is stored in a candidate table (step S4), and processing is ended. 

[0095] Drawing 16 is the flow chart of presumed processing of the reference description projection in step S2 of 
drawing 15 . If processing is started, pattern recognition equipment asks for reference feature -vector r to each 
training pattern belonging to Category Ck first, and is the set Fk of those reference feature vectors. It generates 
(step S11). 

[0096] Next, set Fk The minimum value MINk of an element Maximum MAXk It asks (step S12) and is estimate Qk 
about a closed interval [MINk and MAXk]. It carries out (step SI 3) and returns to processing of drawing 1 5 . Here, 
when taking Margin M into consideration, it is estimate Qk about a closed interval [MINk-M. MAXk+M]. Then, it is 
good. 

[0097] Drawing 1 7 is the flow chart of the candidate category set generation processing in step S3 of drawing 15 . If 
processing is started, pattern recognition equipment is the candidate category set Di first. Initial value is made into 
empty class phi (step S21), a control variable k is set with 1 (step S22), and it is the reference description 
projection Qk. The reference description division element Ri It asks for a product set X (step S23). 
[0098] Next, it is estimate Qk, if a product set X investigates whether it is empty class (step S24) and it is not 
empty class. Corresponding category Ck Candidate category set Di In addition (step S25), the value of k is 
compared with K (step S26). If the value of k is smaller than K, only 1 will increment k (step S27) and the processing 
after step S23 will be repeated. 

[0099] It is Category Ck if a product set X is empty class in step S24. Candidate category set Di Step S26 is 
processed immediately, without adding. And if the value of k reaches K in step S26, it will return to processing of 
drawing 15 . Thereby, it is the reference description division element Ri. The reference description projection Qk 
Category Ck which has an intersection It does not leak and is the candidate category set Di. It is added, this 
processing — each reference description division element Ri ******** — it is carried out 

[0100] Next, drawing 18 is the flow chart of candidate table creation processing in which BORONOI division was 
used. Although the flow chart of drawing 18 is described about the case of a 1 -dimensional reference feature space, 
it is more the same also about the case of the reference feature space of high order origin. 

[0101] reference description division element Ri =[sM [ in / first / in pattern recognition equipment / a reference 

feature space ] when processing is started, and si — i= — it asks about 0, 1 L (step S31). Next, based on 

BORONOI division of a feature space, linear programming is used and it asks for estimate Qk = [MINk and MAXk] of 
the reference description projection to each category Ck (k= 1 K) (step S32). 

[0102] Next, it is each reference description division element Ri like candidate category set generation processing of 
drawing 17 . Receiving candidate category set Di It asks from estimate Qk (step S33). (k= 1, .... K) And each 
reference description division element Ri Candidate category set Di A group is stored in a candidate table (step 
S34), and processing is ended. 

[0103] Drawing 19 is the flow chart of presumed processing of the reference description projection in step S32 of 
!&awingj.8 . category Ck by which pattern recognition equipment was first registered into the dictionary when 
processing was started Receiving representation feature vector Ek Representation feature vector Ej to the other 

category Cj G = 1 Kj!=k) from — it asks for the equation of the flat surface (equal distance side) in the equal 

distance (step S41). However, a feature space shall be N dimension space. 

[0104] When using Euclidean distance as a distance in a feature space, it is the BORONOI division Vk. It becomes a 
super-convex polyhedron in a feature space, and it can be said that it is a subset in the feature space surrounded 
by two or more hyperplanes. Therefore, the hyperplane which is an equal distance side from two representation 

vectors is described by the linear equation which makes a variable feature-vector f= (fl, and f2 fN), respectively. 

[0105] Next, the equation of the obtained hyperplane is used and it is Category Ck. Receiving BORONOI division Vk 
It asks for the alliance linearity inequality to fill (step S42). This alliance linearity inequality is described like for 
example, a degree type. 
[0106] 
[Equation 1] 

A i, f i + A, 2 f z +... + A|„ f N < = B i 
A 2 ifi + Auf 2 + •.. +A 2N f N < = B 2 
A 3 if, t A 32 f 2 +... + A 3N f n < = B 3 



Ax- I, l f 1 + A K .|,zf 2+..,+ A K -hNfN< = BK-| 

<TXF FR=0003 HE=145 WI=080 LX=0200 LY=0850> [0107] Next, the inner product of feature -vector f and certain 
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direction vector h= (hi, and h2 hN) is set to 1 -dimensional reference feature- vector (reference description) r 

(step S43). At this time, it is r=h1 fl+h2 f2+... It is set to +hN fN and the reference description r is expressed by the 
linear combination of each element of feature-vector f. 

[0108] Therefore, the reference description projection Qk The problem to search for can result in the linear 
programming problem which calculates the minimum value and maximum of linear combination r which fills the 
above-mentioned alliance linearity inequality. This problem can be solved with well-known linear programming. 
[0109] Then, it is the minimum value MINk of the reference description r under constraint of the obtained 
simultaneous inequalities using linear programming. Maximum MAXk It asks (step S44) and is the estimate Qk of the 
reference description projection about a closed interval [MINk and MAXk]. It carries out (step S45) and returns to 
processing of drawing 18 . 

[01 10] Here, although linear programming shall be used for presumed processing, more generally the minimum value 
and maximum of the 1 -dimensional section can be calculated using nonlinear programming. In this case, it is 
reference characterized [ r ] by the following values acquired from the element of a feature vector by a certain 
nonlinear function R. 
r=R(f1,andf2 fN) 

At this time, BORONOI division serves as a subset in the feature space surrounded in the super-convex surface in 
a feature space. Therefore, alphabetic character category Ck Receiving BORONOI division Vk The following alliance 
nonlinear inequalities can describe. 
[0111] 
[Equation 2] 

S i( f i, f «, .... f k)< - 0 
S «( f i. f i, ... . f n) < = 0 

' S 3 ( f f 2, .... f H> < = 0 

» 

■ 

S K -i(f nf:,...,f n) < = 0 

[01 12] Therefore, the reference description projection Qk The problem to search for can result in the nonlinear 
programming problem which calculates the minimum value and maximum of the reference description r which fills the 
above-mentioned simultaneous inequalities. The numerical calculation technique by the computer of a nonlinear 
programming problem is widely known as one field of mathematical programming, and can solve this problem using it 

[01 13] In the operation gestalt explained above, although one kind of reference feature vector is used in order to 
ask for a candidate category, it asks for two or more corresponding candidate category sets using two or more 
reference feature vectors calculated from one feature vector, and the configuration which outputs those ANDs is 
also considered. 

[01 14] In this case, two or more candidate tables corresponding to various reference feature vectors are prepared, 
and the candidate category count section is prepared for every candidate table. Each candidate category count 
section considers the value of the reference feature vector of a specific class as an input, and outputs a 
corresponding candidate category set with reference to a corresponding candidate table. Furthermore, the candidate 
category narrowing-down section which calculates the AND of these candidate category sets is prepared, and a 
candidate category set is narrowed down gradually and outputted. 

[01 15] Drawing 20 is the block diagram of the 4th pattern recognition equipment which performs two steps of 
candidate category count using two kinds of reference feature vectors. The pattern recognition equipment of 
drawing 20 is equipped with the reference feature-vector count section 81, the candidate tables 82 and 83, the 
candidate category count sections 84 and 85, and the candidate category narrowing-down section 86. 
[01 16] The reference feature-vector count section 81 is inputted feature-vector [ of N dimension ] f to two 
reference feature vectors rl. and r2. It calculates. The candidate category count section 84 of the 1st step is the 
reference feature vector rl. It considers as an input and the candidate category set D1 (rl) is outputted using the 
candidate table 82 held beforehand. Moreover, the candidate category count section 85 of the 2nd step is the 
reference feature vector r2. It considers as an input and the candidate category set D2 (r2) is outputted using the 
candidate table 83 held beforehand. 

[0117] The candidate category narrowing-down section 86 calculates those product set D1 **(r1) D2 (r2) by 
considering two candidate category sets D1 (r1) and D2 (r2) as an input and outputs it as a final candidate category 
set 

[01 18] the reference feature -vector count section 81 — for example, the 1st element fl of feature-vector f 1- 
dimensional reference feature vector r1 ****** — the 2nd element f2 of feature-vector f 1 -dimensional reference 
feature vector r2 ****** — it outputs. It is the range of the value which each reference feature vector can take A1 
<=r1 <B1 and A2 <=r2 <B-2 If it carries out, the 1st reference feature space, section [A2, and B-2 will serve as 
[ section [A1 and B1 ] the 2nd reference feature space. 

[0119] Here, what divided each reference feature space in the shape of a grid will be used as a reference 
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description division element used as the element of a candidate table. Since it is one dimension, both reference 
feature-space [A1, B1 [ and ], [A2, and B-2 are them as follows, respectively LI piece and L2 It divides at the 
section of an individual and let each section be the reference description division element. 

A1 =s0 — < — si — < — s2 — < ... <sL1=B1A2 =t0 — < — tl — < — t2 — < ... <tL2=B-2 — this — reference 
feature-space [ — each section [si— 1 of A1 and B1 and si turn into reference description division element R1i to the 

reference feature vector rl. here — i= 1 LI it is . Moreover, each section [lj-1 of reference feature-space [A2 

and B-2 and ti turn into reference description division element R2j to the reference feature vector r2. here — j= 1, 
.... L2 it is . 

[0120] The candidate category set to each reference description division element Rl i or R2j is called for by 
presuming the reference description projection over each category using the feature-vector set for study. Only 
sufficient number shall contain the feature vector to which the feature -vector set for study belongs to each 
category. Specific category Ck The presumed approach of the reference description projection of receiving is as 
follows. 

[0121] First, category Ck belonging to the feature-vector set for study The 1st element f1 of the set of the 
receiving feature vector to a feature vector It asks for set F1k. This set F1k is Category Ck. The distribution which 
approximates the 1st reference description projection is formed. The minimum value MIN (Flk) and Maximum MAX 
(Flk) of an element of this set F1k are calculated, the further specific margin M is taken into consideration, and it is 
Category Ck. It is estimate Qlk of the 1st reference description projection Q1k= [MIN(F1k)-M, MAX(F1k) +M] 
It carries out. 

[0122] Presumption of the 2nd reference description projection is performed similarly. First, category Ck belonging 
to the feature-vector set for study The 2nd element f2 of the set of the receiving feature vector to a feature 
vector It asks for set F2k. This set F2k is Category Ck. The distribution which approximates the 2nd reference 
description projection is formed. The minimum value MIN (F2k) and Maximum MAX (F2k) of an element of this set 
F2k are calculated, the further specific margin M is taken into consideration, and it is Category Ck. It is estimate 
Q2k of the 2nd reference description projection Q2k= [MIN(F2k)-M, MAX(F2k) +M] 
It carries out. 

[0123] And reference description division element Rl i and R2j which were obtained by doing in this way, and each 
category Ck It asks for reference description division element Rl i, candidate category set D1 =(r1) D1i which should 
be made R2j at a group, respectively, and D2 =(r2) D2j as follows using receiving reference description projection 
Q1kandQ2k. 

[0124] Reference description division element R1i and category Ck in which corresponding reference description 
projection Q1k has an intersection A set is set to candidate category set D1i to the reference description division 
element Rl i. What enumerated the categories to which the feature vector which has the value of the reference 
feature vector belonging to reference description division element R1 i by this may belong is set to candidate 
category set D1i. 

[0125] Category Ck in which similarly reference description division element R2j and corresponding reference 
description projection Q2k have an intersection A set is set to candidate category set D2j to the reference 
description division element R2j. What enumerated the categories to which the feature vector which has the value 
of the reference feature vector belonging to reference description division element R2j by this may belong is set to 
candidate category set D2j. 

[0126] The candidate table 82 which the candidate category count section 84 refers to is constituted by the group 
of reference description division element Rl i and candidate category set D1i. Similarly, the candidate table 83 which 
the candidate category count section 85 refers to is constituted by the group of reference description division 
element R2j and candidate category set D2j. 

[0127] the value of the reference feature vector to which the candidate category count section 84 was given — r1 
it is — a case — first — this value r1 It asks for reference description division element Rl i which belongs. Next, 
using the candidate table 82, it asks for candidate category set D1 i corresponding to reference description division 
element R1i, and it is outputted. It is expectable that the category to which an input feature vector belongs is 
contained in outputted candidate category set D1i. 

[0128] the value of the reference feature vector to which similarly the candidate category count section 85 was 
given — r2 it is — a case — first — this value r2 It asks for reference description division element R2j which 
belongs. Next, using the candidate table 83, it asks for candidate category set D2j corresponding to reference 
description division element R2j, and it is outputted. It is expectable that the category to which an input feature 
vector belongs is contained in outputted candidate category set D2j. 

[0129] And the candidate category narrowing-down section 86 asks for two candidate category set D1i and product 
set D1 i**D2of D2j j, and considers it as a final candidate category set It could presume that the category to which 
an input feature vector belongs still belonged to the candidate category set outputted from the candidate category 
narrowing-down section 86, and the number of elements has become less than two candidate category set D1i of 
origin, and D2j. Therefore, it turns out that the candidate category narrowing-down section 86 has played the role 
which narrows down a candidate category set gradually. 

[0130] According to such pattern recognition equipment, since two 1 -dimensional reference feature vectors are 
used, the number of candidate categories can be reduced from the case where the number of 1 -dimensional 
reference feature vectors is one. Moreover, since the number of the reference description division elements is 
sharply reduced compared with the case where one two-dimensional reference feature vector is used, storage 
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capacity required in .order to hold a candidate table can be saved. 

[0131] Thus, it is possible by using two or more reference feature vectors of comparatively a low dimension highly 
precise and to realize the pattern recognition equipment which performs pattern recognition at a high speed with 
sufficiently practical storage capacity. Although processing which asks for such two or more candidate category 
sets may be serially given to a target, if it carries out to juxtaposition, the processing time will be mitigated further. 
[0132] By the way, the reason which can be referred to as that the pattern recognition equipment of this invention 
does not reduce most recognition precision is explained. After performing the high-speed classification by this 
invention, specific classification which used distance count of the original feature vector is usually performed 
further, and the category of an input configuration is specified. 

[0133] The accumulation recognition precision of the candidate category set outputted as the fall of recognition 
precision is zero means that the precision of the specific classification which will be performed in the latter part is 
guaranteed (it does not drop). Here, accumulation recognition precision points out the probability for any one true 
category of an input configuration of the candidate category set to be contained. Therefore, as for accumulation 
recognition precision, ideally, it is desirable that it is always 100%. 

[0134] It should just be beyond the precision of the specific classification which is not necessarily required but is 
performed in the latter part that the accumulation recognition precision of the outputted candidate category set is 
100% in fact. Therefore, pattern recognition equipment [ as / whose precision fall is zero practically ] is realized by 
registering the candidate category set containing a sufficient number of candidate categories into a candidate table. 
[0135] Since the classification error with the same said of specific classification will be started when a true 
category does not exist in a candidate category set (i.e., when a classification error is started), it is thought that a 
final accumulation recognition precision does not change. In this semantics, the high-speed classification by this 
invention has realized improvement in the speed without a precision fall, using constraint of the given specific 
classification well. 

[0136] The reference feature vector used by this invention does not need to be a partial vector of a feature vector 
which was not necessarily mentioned above, and the vector of computable arbitration can be used for it as a 
reference feature vector from a feature vector. For example, the compression feature vector used with the pattern 
recognition equipment shown in drawing 23 is also one of them. 

[0137] Drawing 21 is the block diagram of the 5th pattern recognition equipment which asks for a candidate 
category set by making a compression feature vector into a reference feature vector, and performs specific 
classification to it. The pattern recognition equipment of drawing .21 is equipped with the feature- extraction section 
91, the description compression zone 92, the candidate category count section 93. the specific classification section 
94, the candidate table 95, and a dictionary 96. 

[0138] The feature- extract! on section 91 extracts a feature vector from an input configuration, and the description 
compression zone 92 performs suitable conversion for a feature vector, and it generates a compression feature 
vector smaller than that of a number of dimension. Next, the candidate category count section 93 asks for the 
candidate category set corresponding to the given compression feature vector with reference to the candidate table 
95. 

[0139] The specific classification section 94 calculates the distance of the representation feature vector held at the 
dictionary 96, and the feature vector of an input configuration to each candidate category of the candidate category 
set outputted by the candidate category count section 93. And a candidate category is rearranged into order with a 
small distance, and the train of a number of categories specified from the thing of the minimum distance is 
outputted. 

[0140] According to such pattern recognition equipment, by choosing suitably the conversion used for the 
description compression, a desired reference feature vector can be generated and a candidate category set can be 
more effectively narrowed down using the candidate table corresponding to it. Moreover, distance count is not 
performed using directly the compression feature vector obtained as a result of the description compression, and in 
order to use it as a reference value for lengthening a candidate table, the fall of processing precision is not caused 
theoretically. 

[0141] Next, drawing 22 is the block diagram of the 6th pattern recognition equipment which asks for a candidate 
category set by making a compression feature vector into a reference feature vector, and performs a kind and 
specific classification very much to it. The pattern recognition equipment of drawing 22 is equipped with the 
feature- extraction section 101, the description compression zone 102, the candidate category count section 103, 
the Oita section 104. the specific classification section 105, the candidate table 106, the compression description 
dictionary 107, and a dictionary 108. 

[0142] About the function of the feature-extraction section 101, the description compression zone 102, the 
candidate category count section 103, and the candidate table 106, it is the same as that of the feature-extraction 
section 91 of drawing 21 , the description compression zone 92, the candidate category count section 93. and the 
candidate table 95 respectively. 

[0143] The kind section 104 calculates very much the distance of the compression feature vector held at the 
compression description dictionary 107, and the compression feature vector of an input configuration to each 
candidate category of the candidate category set outputted by the candidate category count section 103. And a 
candidate category is rearranged into order with a small distance, and the train of a number of categories specified 
from the thing of the minimum distance is outputted as a candidate category set. 

[0144] The specific classification section 105 calculates the distance of the representation feature vector held at 
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the dictionary 108, and the feature vector of an input configuration to each candidate category of the candidate 
category set outputted very much by the kind section 104. And a candidate category is rearranged into order with a 
small distance, and the train of a number of categories specified from the thing of the minimum distance is 
outputted. 

[0145] In order that according to such pattern recognition equipment the kind section 104 may narrow down further 
the candidate category set outputted by the candidate category count section 103 and may pass it very much to 
the specific classification section 105, the candidate category set as the object of specific classification is limited 
more, and processing is accelerated. 

[0146] In drawin g 21 and the pattern recognition equipment of drawing 22 , although the compression feature vector 
is made into the reference feature vector as it is, the partial feature vector of a compression feature vector may be 
instead used as a reference feature vector. In this case, the number of dimension of a reference feature vector is 
reduced further, and processing is accelerated. 

[0147] Linear transformation can be used as conversion which generates a compression feature vector from a 
feature vector. As compared with nonlinear conversion, count effectiveness of linear transformation is good in order 
to compress a feature vector by comparatively simple count called the product of a transformation matrix and a 
vector. As the description compression approach using linear transformation, canonical discriminant analysis, 
principal component analysis, etc. are known. 

[0148] In canonical discriminant analysis, from the feature vector of N dimension of the sample pattern given for 
every category, the variance matrix between categories and a category internal variance matrix are calculated, and 
it asks for the characteristic vector using those variance matrices. And while those, M characteristic vectors (M<N) 
are chosen, and M-dimensional space is defined. If a strange pattern is inputted, the inner product of the feature 
vector and each characteristic vector will be calculated, and the M-dimensional compression feature vector which 
uses those values as an element will be generated. 

[0149] In this analysis method, the average feature vector of N dimension is projected to M axes of coordinates 
specified by M characteristic vectors so that distribution between categories may be enlarged and category internal 
variance may be made small. In the M-dimensional space after the description compression, the patterns of a 
different class separate by this, and conversion which the patterns of the same class approach is performed. 
[0150] On the other hand, in principal component analysis, the group of a principal component vector which each 
category leaves mutually is calculated for every category. And the new space according to individual which sets an 
axis of coordinates as a principal component vector for every category is generated, and a compression feature 
vector is generated with projecting the feature vector of an input configuration on the principal component vector of 
each category. The distance of an input configuration and each category is calculated using a compression feature 
vector. 

[0151] When the category which is similar in the field in which it approached in the feature space exists according to 
this analysis method, a more exact recognition result is obtained by making the feature vector of a recognition 
object pattern project on the principal component vector corresponding to each category. This analysis method is 
mainly used for distinction of the character pattern which the category resembled closely few etc. 
[0152] In the operation gestalt explained above, the distance count between vectors is needed by generation 
processing of BORONOI division, the Oita processing of a candidate category, and specific classification processing. 
At this time, it is possible to define and use the distance of arbitration other than general Euclidean distance. For 
example, a well-known city block distance, the Mahalanobis distance, false Mahalanobis distance, a BEIZU 
discriminant function (Bayes discriminant function), a false BEIZU discriminant function (Modified Bayes discriminant 
function), etc. may be used. 

[0153] Here, each distance between vector g= (g1, and g2 gn) and vector p= (pi, and p2 pn) is defined as 

follows. [City block distance] 
[01 54] 
[Equation 3] 

D CO (gi P) = 2^ | g i - p i t 

[0155] [Mahalanobis distance] 
Dm =(g, p) (g-p)T sigmaj-1 (g-p) 

Here, p is the average of the training pattern pi (i= 1, 3 [ 2 and 3 ], .... N) of a specific category, and sigmaj-1 is a 
covariance matrix (it is also called a distributed covariance matrix) defined by the degree type. 

sigmaj =(1-/N) sigma(pi-p) (pi-p) Tsigmaj They are phi 1, phi 2, .... phin, respectively about the characteristic vector 

which sets characteristic value to lambda 1, lambda 2 lambdan (lambda 1 >lambda2 > ... Xambdan), and 

corresponds. It carries out and is phi= (phi 1, phi 2, .... phin). 
If it carries out, Dm (g, p) can be written as follows. 
[0156] 
[Equation 4] 
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[0157] [False Mahalanobis distance] 
[01 58] 
[Equation 5] 

. U T (s-p)) 2 

D m 2 (3,p)= S 

[0159] It corrects, lambdai =lambda (regularity) (m«n. m+1 <=i<=n) 

This false Mahalanobis distance is proposed in order to solve the practical problem (computational complexity and 
count precision) of the Mahalanobis distance, and it is based on the view of the false BEIZU discriminant function 
mentioned later. 
[BEIZU discriminant function] 

Kg) =(g - p)T sigma-1(g^p)+ ln|sigma | — this BEIZU discriminant function (secondary discriminant function) 
expresses the distance of Vector g and Vector p, and an object serves as the optimal discriminant function, when 
an average and covariance matrix of a feature vector are known according to normal distribution. 
[False BEIZU discriminant function] 
[01 60] 
[Equation 6] 

, x v (<Pi T (g-p)> 2 

f t (g) = T 

X i 



i * 1 



+ 



(<t>i T (g-p)) * 



i = K - I 



k * i 



+ in ( n x 

i = 1 



tl x KM ) 
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[0161] This false BEIZU discriminant function is a function invented in order to solve the problem of the count 
precision about a high order characteristic vector in discernment of a complicated character pattern etc. The 
category description set is distributed according to normal distribution, and such distance assumes the case where 
the appearance probability of each category is the same. When the determinant of the covariance matrix of 
distribution of each category is the same, specific classification is performed based on the Mahalanobis distance or 
false Mahalanobis distance, and when [ which is not same ] general, specific classification is performed based on a 
false BEIZU discriminant function. 

[0162] Moreover, this invention is applicable not only to a character pattern but a two-dimensional graphic form, a 
three-dimension body, and the technique of recognizing the pattern of the arbitration containing the image of human 
beings face. 
[01 63] 

[Effect of the Invention] According to this invention, improvement in the speed of categorization can be achieved by 
using a candidate table in recognition processing of the pattern of arbitration, suppressing the fall of recognition 
precision to the minimum. If a candidate table is created based on the same division as each category especially 
registered into the dictionary for specific classification, it is possible to make it not reduce the precision of specific 
classification. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 

DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 
[Drawing 1] It is the principle Fig. of the pattern recognition equipment of this invention. 
[ Drawin g 2] It is drawing showing the record of a candidate table. 
[Drawing 3] It is drawing showing a category and a reference feature space. 
[Drawing 4] It is the block diagram of an information processor. 
[Drawing 5] It is drawing showing the structure of a candidate table. 
[Drawing 6] It is the block diagram of the 1st pattern recognition equipment. 
[ Draw ing 7] It is the block diagram of the 2nd pattern recognition equipment. 
[Drawing 8] It is drawing showing the 1st reference feature space. 
[Drawing 9] It is drawing showing the 1 st candidate table. 
tDrajwingJOl It is the block diagram of the 3rd pattern recognition equipment. 
[Drawing 1 1] It is drawing showing BORONOI division. 
[Drawing 1 2] It is drawing showing the 2nd reference feature space. 
[Drawing 13] It is drawing showing the 3rd reference feature space. 
[Drawing 14] It is drawing showing the 2nd candidate table. 

[Drawing 15] It is the flow chart of candidate table creation processing using a training pattern. 

[Drawing 16] It is the flow chart of presumed processing using a training pattern. 

[Drawing 1 7] It is the flow chart of candidate category set generation processing. 

[Drawing 18] It is the flow chart of candidate table creation processing using BORONOI division. 

[Drawing 19] It is the flow chart of presumed processing using BORONOI division. 

[Drawing 20] It is the block diagram of the 4th pattern recognition equipment. 

[Drawing 21] It is the block diagram of the 5th pattern recognition equipment. 

[Drawing 22] It is the block diagram of the 6th pattern recognition equipment 

[Qrawlng 23] It is the block diagram of conventional pattern recognition equipment 

[Description of Notations] 

1, 51 t 61, 91,101 Feature-extraction section 

2 92,102 The description compression zone 

3,104 It is the kind section very much. 

4,107 The compression description dictionary 

1 1 Table Storage Means 

12 Candidate Category Count Means 

13, 41, 53, 64, 82, 83. 95,106 Candidate table 

21, 54, 71, 73 Feature space 

22, 55, 72, 74 Reference feature space 

31 CPU 

32 Memory 

33 Input Unit 

34 Output Unit 

35 External Storage 

36 Medium Driving Gear 

37 Network Connection Equipment 

38 Photo-Electric-Conversion Equipment 

39 Bus 

40 Portable Record Medium 
40' External equipment 

42, 52, 62. 84, 85, 93,103 Candidate category count section 
63 94.105 Specific classification section 
65 96,108 Dictionary 

81 Reference Feature-Vector Count Section 
86 Candidate Category Narrowing-Down Section 
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[Drawing 11] 
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[Drawing 1 3] 
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[Drawing 1 5] 
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[s 4 , s 5 ) , R 6 = [s 5 , +00) (D7 0(0#i# 
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(0 0 6 4] XT*}) &mM&<DM& C SET > I**"** 
tt, Atl3:?P'<? ->Pw<Dm'fZ>$'T* } J c IN ec 

SET ^^tf^ffi^X^V *^CcAND**i^l-f ^ 
[0 0 6 5] f¥*ffl#l!gfl 6 3 tt, <£*i# tUSSB 6 

^XEBtftHSrtf 9« $f6 5(l 'S-X^T^y fc** 
-rSftSflPtR^* h/u4HS«L-C*3»K !¥JWl#JgaS6 3 
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4*«^<^ h/UEi , E 2 , E 3 , E 4 , E 5 , E 6 
JLhtitibZ, ttfc-tZtfv S-tftPWi , V 2 , 
v 3 . v 4 , v 5 , v 6 mi 1 J: 0 (:^5o 
13 1 ik^T. /f py^»«v 3 ^/-Kny^5>fijv 5 

<omft±:<Ol»WL'<9 h/uf = (f 1 , f 2 ) «U 
fR^^ hA-E 3 £E 5 ^?>*IEK^)ffi«twfc5, te<£>*fl 

[0069] — N^7cco#m^r^^iot>r, ^— 40 

RBrt^«¥fl^H*;h,fcfii!b#ffi{££ft!K m^KSg^l 
fdte^£®<££ ^7/1^^ (Mahalanobi 

[0 0 7 0] r^T% Nft5c3gBa^>jBftBBi:ttN- 1 * 
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[0 0 7 3]Fi^^ JB2©^^-^B«3S«<D»*i: 

I»»t»oJ: 5ftX*#^=ry C k (O^^^, to# 
RRW»^WB3RRi^»-rsiR*l*7 t ='y*-&D i <h-r 

Lfcti^i: ft^o 

[0 0 7 4] Hl2fl, ^7^!) CO/tfP / 4ft%\\k 2 * 

B, C, D, E, F , G, H, F, J , K, L, M£# 
IB 7 2-M^*T5C<!:{cJ:«9. #RS4#tt^M 7 

««ds#fia»»i*»<75«isffl[^fts, 

[0 0 7 5] ^IT, ##IStt»#W*»lC#L-C, * 
[0 0 7 6 ] ^CT'te. ^f^y B, C, G, H, KCD 

K4:R]*I^, Z.tib%mmt-tZ>M& (B, 

c g, h, k) &&m&m&^mmx\ctt!&-rz>mffi 

[0 0 7 7 ] f^M^-y/U6 4lt #Ra«»5>W»*R 

6 3 tciSi- 0 

[0 0 7 8] §^^5>mS5 6 3 «U ^§6 5^#ilt, 
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vmir 0 tit, Ztxbn&Km&m^t h^A^S 

[0079] r^j:?^ f$mftmT?m^btiz>&x^ 

^f^y o y 4 5>W<o 

[0 0 8 0] rtti^ct v . A^t?/^-y^its^ 

S:*fT-r6^^-^B«K3£«*s|l^*ttSo Ell 
<D^ift (f i , f 2 ) &2&7C<o#IS#«'<* h/Ur <ir 

fc ymz>mv>mm&. f i e [Ai , bi ) , f 2 e 
[a 2 , b 2 ) fc-r**. &&mm la x , bi ) x 
[a 2 , b 2 ) tf&m&&&mkt*z> 0 

[0 0 8 1 ] 4(Dg|Ri45#I»a» 
SiJ^^tLT, #S849ttSm [Aj, Bi ) X [A 2 , 
B 2 ) »^#t;i#fflLfcfc<a&JB^5 0 rcofcifc. 

m^-rx Era [ a i . Bi ) ^rLi + hb<*>k 

BC»»l, EM [A 2 , B 2 ) ^L 2 + 

Aj = s-i< so < sj <s 2 <• • • < s li = B i 30 
A 2 = t -i< t o < t i <t 2 <• • - <t L2 =B 2 

) li, 

R(i ) =£gff2 [Si-i , Si ) X [ t j-i , tj ) 

COX o (C^^^tv6o r^T% i=0, 1, • • • , L 

i , j = o, i , • • • , l 2 9 , # 

tt. L j =5, L 2 =3£LT, (5 + 1) X (3 + 

1) = 2 4fi<o#fia»»5)'SiJs*jw^w$*xri/^o *0 

[0 0 8 2] R'K, ftX*"*"^^ y C k ll^tS^D/ 

tixf)(0#i#f8^^ h/u (f 1 , f 2 ) <z>{f<ateH 
#BR»a3*jB<0«t5gffl[Q k tt6 0 tit, 

[0083] mm^-^/^e 4n. &m&1& 
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[0 0 8 4] 01 3tf>4#®£PiJ] 7 3 iCjo^Ttt. # ^ 
B, C, K(Oj*»dS#Ba»»^WS»X= [s 2 > s 
3) X [t 0 , t! ) ^*iia^^«FOCr)T-> Ztlb& 

mmt-tz>$k& (b, c, k) tf&mVfW&mmmxiz 

H, K^J*»#a*IH»»#MS*Y = [s 2 , s 3 ) X 

[ti , t 2 ) £#j§as$>«:#otf>-e. rtb&Sr**^ 
-TZMS (G, h, k) as#BS4*»#WK*Yi£#fSi- 

6 4 12, Wx.tf, 0 1 5 
[0 0 8 5] T=tV 9t&& 6 2 f*. A;>J S 

r 2 t?4><&#'8\ r = (r 1 , r 2 ) ^#fiB«F»-<^ h 

^atu *i\ r^tt(ojR-r5#Ba«F»»«iaHBR 

(i ) £#£>6o #fiS«F«^#J5l3BR(i ) fi2 0C7t;O 

Tx #HS4»a^«fi«R(i ) i-^ic-r^^M^^^y 

^D (i > ^r*^T. -tixS:l¥jW»Sffl5 6 3^«-T c 
[0 0 8 6] :(DJ: 9 #Ba«p»^Mfi 1 *5c2glWJw 

[0 0 8 7] 4i\ #RRW«ffim«r»MMlcttK/xii: 

K (i, j) T'itC^CtSo ^7^yC(D#M 
fflW^<OltJg*s, t&^-K (i, j) ir^il^^^^o^ 

^f^yMS (i t j) co^m<*ri-6o 

[0 0 8 8] w 0 LXr^fc#P^a^P^^#fe J fK 
(i, j) ir^ffl^xrry^^s (i f j) Offl*, 

^^7 5/^^ ( i , j) tmffix'r^v m&izm-p 

[ 0 0 8 9 ] #«#l»ffl«-*r»*fb*i*»iv-c-s|f- 
6^^r%^6 0 r^>»-&, #fia«p«2gPfl^##ciy >f 
fi^-^^^r (xi , yi ) "CSt^i:lct5 0 ^f=fy 

c^)#i^r^^/i\ s^^k^ (x i( yi ) 
yc^r, ^ny^s^Vi iw^-r^f^ti^x^y m&s 

( i ) O^S^t^o 

[0 0 9 0] r 9 LTt^fc^i^^FBl^^D/^ 
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[0 0 9 1 ] rtte>^)^{wio^T, fc6^f^y(D#i 

Lfc2oo*S^*6. ion ^ms<*->M& 

tzMfc-tZ&WL^f h/u«r -titbit* 

[0092] ::t\ B15WH1 9*"eSr#fiBU<C 
fcS*lf-^fP*JQ!l^7P-f-ir- h-Cfc6o Hi 

[0 0 9 3 ] M*3a**M*ft£ftS ^#-^BBMS« 
= C s i-i, s i ) S: i =0, 1, • • • , LMol^T* 

Ufsz/si) 0 m^. #^r^yc k (k = 
i, • ■ k) {ztt-tz&m&mttmommmQk = 

[M I N k , MAX k ] - ^tf>#JS4$»£ 

[0 0 9 4] ScK, #*!!Btttt£««»Ri 

i^f^yi^Di *3effiQ k (k = i, • • 

[0095] B16H, 5(D^ry/S 2{C*3tt5 

Ur^/S 1 1 ) o 
[0 0 9 6] ft^F k O^H^S/JvffiM I N k <h 

iiclMAX k Uf^S 1 2) , [M 

I N k , M A X k ] ZmfemQk t Lt (XTy^S 1 

3) . mi 5 (Oin:l5. ::t-; ^^^7Mt#t 

-f 61^(1, HKPiQ [M I N k — M, MAX k +M] £ 

[0097] il 711, H 1 5 c^*^ :/S 3 iCiottS 
Si^7=ryMMM©7D-ft-ht*fe6 0 & 

1) . fil»2ERk «r 1 tJsi^T (^7y/S22) . # 
(J*?" vzfS 2 3) o 
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[0098] &t£, mm&x&&&<&fr¥ofr$:m^ 

U7^S24) . *fta*ffi**-ctttt*ttf* #££ffi 
Q k i:^t6^7^yc k ^i^r^yi^Di ic 

*D^l U7J//S2 5) , k(Dffl^rK<btfcK-r5 (^t 1 
^S26)« k <om&K X 9/J>£*t*ttf* k & 1 

>fy^y^yhi U7^S27) , ^77/523 

[0 0 9 9] ^f5/7 p S2 4Ciol>TSI^X^^i^ 

70 I^|:^T^S2 6C0^3l£tT9o tlx, * 

7^S2 6fC^>TkOffitfSKlCii-r££, 01 5(D 

»»*HBQ k ds*iiffl^S:«fO«t 5**x=f y C k 

[0 10 0] #clc, 11811, #uy ^giJSrffl^fclsl 
ffi^-^/i^ffrS&Jitf):? n — ^ — hffcSo Hi8<£> 

loioi] &m&mi&£tiz>k. '**-^mmmm 
a. *i\ #Raw»ggpfl^*3*te#BB4*a»ws*Ri 

= [ s i-i, s i ) * i = 0 , 1, • • • , L COPT^ 
^6 {^7^/53 1) o Ml, ^7^yC k (k = 
1, • * • , K) ^»i--6#BB»«»»o«t«KQ k = 
[M I N k , MAX k ] £^ *S»SBB^>#ci y -f^fiJS: 

[0102] <k\^. hi 7 <DmM*>T=t!) 

j<? T-=ry ^^Di fefemQw (k=l, • • K) 
frh$tV)Z> ^7^S33) q ^IT, ##HR«M»# 

{^t&^U (Xf^S34) . M^»Tt6, 
[0103] Hl9f±, Hi 8 CO^-r ^^S 3 2 l^^ott 

^> ^n^^co^ v^rfy C j ( j = 1 , • • • , K ; j 

*k) ic^r-r^ft^^m^^ h/^Ej tfrbmmmizh 

[0104] ^a^Pfltciojt^Kgi^ it^-^ y s/ k 

ti. #m-<^ h^f = (f i , f 2 , • • • . f n ) * 

so [0105] »e>tt^jS¥ffi«>*S^:^ffl^T. 
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^5£ll, W;Ltfs &3S<oj: 5(-«Bj£Stt5« 

Auft + A u f 2 + 
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• • • 



10 10 6] 

+ A, N f N < - B , 



A 2 1 f i + A 22 f 2 +... + A 2N f N < = B 
A 3 ifi + A 22 f 2 + ... + A 3N f n < = B 



1 Ax- |, | f t + A K -l,zf 2+..,+ Ait-hHf N< == Bj(-l 



[0107] %f'&^? Vfr f thZXfa^f 

h= (hi , h 2 , • • • , h N ) h<Dftm&. I&tc 

4 3) o r <Dt 

r = hi f i + h2 f 2 + " * ' + hN f N 

[0 10 8] Lfc^oT. * fig Qk SrsRfcSIBI 

Hfl, iB14»*^9a«rifct J: 5 4»»»* r ^ 

[0 10 9] J**tHBtt4rJB^-c\ fthtittm 

tt*£i£<D®m<Oi>£X% >B«p»r^ft/hfiMIN k 
if«MAX k Ur^S44) s KERB 

[MIN k , MAX k ] ^#I#W^<?)«^(Qk * 
IX (Xr^S45) . El 1 8 ^llcM5o 

[oiio] «t3e«3ffi^iR«tHBj5feftfflu^ 

r =R ( f x , f 2 , • • • , f N ) 

f^UCk l:»t5#p/>f»»)v k II, *o<fc5*ii 

[0111] 

[ic2] 

S 1 ( f 1, f in . , f M> < = 0 



S *( f », f I, . . f m)< = 0 
S 3 ( f t. f 8, .... f N) < - 0 



i 



1 Sm( f f 



2 > 



■ f m)< =» 0 



[0 112] Lfc^oT. #HB«MSM*J»Q k «r#«>5BS 



20 



30 



40 



[0 113] «±lftlBLfcltJft»ffiiC*5l>rtt, 

So 

[oi i4] :©8^, «^*#fiaw»-<^ h/Mc*»s 

[01151122011, 2fgO#Wl8 / <^ h/^ffl 

2, 8 3, mffijj^zt}) 1+^^5 8 4. 8 5. tS&Xfft 

[0 116] #fiS#®-<^ h/Uft^a58 1*1. A^^n 

/Uri , r 2 SB 1 §*RI<0{£M;27 if =f y ftH 

£&8 4 II, #B84#®-<* r ! £A^<h L, 



{^M^x=fy^^D 2 (r 2 ) ^rUi^i-6 0 
[0 1 1 7] mW$T*D JK¥)^^gB8 6fl. 2o<7) 
^Di ( r i ) , D 2 ( r 2 ) ^A^J i: L 



SO 



T. -tttb^a^Di (ri ) f)D 2 (r 2 ) 

[oi is] *fia«p»-<^ h /pw- was 8 in. 



34403331 $\mm ' <&*PCT 



21 

* h/ir i tit, tewt^f h/u i<D%2<omm f 2 £ 

AHR^ Y^(Ot f^^^fflCO^H^A! ^ r i < Bi , 
A 2 ^r 2 <B 2 t-ret, EPiS [Ai , Bi ) i 
*>S*RB«M»3gR8, EPifl [A 2 , B 2 ) as»2<B#fiB«MS 

[0119] r^-eis. m%b"r-'?j\'<nmmbt£z>&m 

tchm&m^Z^ t 0B34$&£ra [Ai , 

B i ) ls£Tf [A 2 , B 2 ) tet hiz i ik7tX*&Z>fr 
e>> ^tihfr, ^rti^ft&GQJ; o \z L x L 2 i@<£>E 

Ai = so < s i <s 2 < • • * < sli=Bi 
A 2 =t 0 <ti<t 2 <'--<t L2= B 2 

-*UCJ: 9> #BB1*»2gPJJ [Ai . Bj ) o^tt^tto 
EPA [sj-i , si ) ^ ^m^m^f h^ri (c^f 
S#B8«f»^»I5*Riit*6o --X% i=l, • • 
L i XtbZ> 0 $Hgtt»ggPiQ [A 2 , B 2 ) <0 

-tix-t'ix^KW [tj-j, tj ) *K #Bg4*«^<^ h/w 

r 2 (c»i--5#fia4»»»fiJS*R2ji:*S- --"C. i 
= 1 , • • • , L 2 T*£>5 0 

[0121] ^f, ¥Sffl«r«-<^ h^^JCjR-r^^ 

^^MFi k (Oii(OS/MMI N (F 
Ik) i3j;t/ijclMAX (Fi k ) ££fc4#J£<Z> 

Qlk= [M I N (F^) -M, MAX (Fik) + M] 

t-rz> 0 

[oi22ii2 <D&m&Witt&<omj£i>mm\z. uxn 

2<D^3f f 2 Oft^F 2k ^^i65o rOig^F 2k te> # 

r^yc k ^»2 0#R8«Fl8W»Srjfiffil-r6»*Sr»fiK 

-f5 0 ^O^^F 2k C0^^Oiir/J>ilM I N (F 2k ) *5cfc 
M«MAX (F 2k ) § — 

Q 2 k= [M I N (F 2k ) — M, MAX (F 2k ) +M] 
[0123] ^LT, r<OJ: 5lcLT»e>*xfc£Ha«M» 
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^fj^^Rn, R 2 j£> ^f^yc k iztt-tz&mft 

1 (rj ) =Dn, D 2 (r 2 ) = D 2j £, &<£>J:5lC 

[0 12 4] *!3ttft#«IBXRii&. 
«»jKQik* s *aa^Sr«F^«t 5 KtiT*}) C k (Dffi^ 
*0#BB«p»»WS»Riilc»-r-6«»*7 l ^y* 
^Dn^teo r*Ll£cfc!K #fia«F»5>9JS3BRiifwjR 

m&ViibteZ* 
[0 12 5] f^^(cLX. #flBtt»#«»tBR 2 ji:* *t 

yc k 4>&<fr*r % «t<o#Ba»tt»wsgRR 2 jiw»-r-5« 

S3RR2j{wJR-r6*Ba«r«^<^ h/KZ)ttS:»o«l^^ 

HM^^^y^D 2j t*6o 

*0 [0 12 6] H«^r^y H-SSI5 8 4 ^fiSttx 
-^8 212, #BB1*«^»JB3RRiii:fiHi*f l =fy* 

mmm R 2 jt mm* ^^y d 2 j^mic j: «9 »^ ^ 

[0 12 7] f^M^x^y f+®LglS8 4*1. ^^l^nfc# 

i ^JR-r^#BB4»»»«»3RRiiS:*«>5. ^ffi 
f-^8 2tfflK, #fia«»»«HllRRii(cS*JS:-r 

[0 12 8] MHIT, ^ffi^^^y ffgL^8 5(L 

40 mmx*£z Q 

[0 1 2 9] ttt, fi^f^yR!9ii^S8 6ii, 

dt y jk t) i^^as 8 6 a* <b tB^ Zthtzi&ffi* x =r y 

^^il a^^®-<^ h/KOM-rs^^^yasft^sjn 

LX^^iiStS, a^o % ^cD^mmfi7i;0 2o<D^ 

fc^ot, Rii^T 1 ^ y«oa^«8 6tt. ia^f^ 
5^ a>6o 
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[oi30l :oj:5<j:^-y 9 «iiaM> l 

[0131] Z<D£ b iz x ft&ft&lfc7b<D&m%r&'<? 

[0132] *»flio^-yB*8l3i s B 

[0 13 3] |gafc»S^(£T* s ^D-Cfc-5^«, 

i o o%t'fcs:H5g^ n>o 

[0134] HBRJwtt. W^^tt/Si^M^x^y $k&<D 

mmuffitusttf i o o r. ta&~r uts*stt 

[0 13 5] tu il^r^DI^tCSo^f^ 

it»m&m<Dmmi:5*<mmi>x* waters low 

[0 13 6] ^ISWT-^S^fiBWtRx* h'Wi, i^T ^ 

0 2 l^^^-V»»|SHli. «FfS«mgI5 9 1. 

Sg^i 9 2 . mffi* "r*V 9 3 . f£$B#Sgfl 9 4. 50 
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[0 13 8] $MtttttJg&9 1 ft. A*^^-^^e>«» 
x* h/u*«HJU «MWEffi«P9 2 ft. «F«x^r h/Hc 

[0.1 3 9] f¥J8B5Hgg&9 4f*. fcffi*?'*}) »S«9 

5 0 tit, lEBlO/hSftW^^^^y Srafet/ft^t 
[0 14 0] r^J: 5*^^-^B»SSS(w<ttttf, 

[0141] Sen, B22lt ffitt#«x^ h^ft^Ra 

■0)*«Bt?*)5o 0 2 2<&a?* — ^»»3£tattu 1*18 
Hittlffil 0 1, ft»m*!8M 0 2. fcffiXir^}) s-usr 
10 3. 104. ffffi^lSffi 105. flg*!^- 

^/H 0 6 . 10 7. *5 J:t/»* 1 0 8 * 

[0142] ftmtbmn 1 o 1 . #®jesri^ 102,1 

1 0 3. ioJ:(;S«7-^H0 6(D 
HMBKioi^TrtU -ttb^Eftb. H 2 1 0«»ttttJffl 9 1 , 

«f«JEI8ffl59 2. {^ffi^X^y ft^gi59 3. 

[0 14 3] ^c^S^i o 4^. «w^^=ry w-Sffii 

x =ry «k*-C ; Mfl«) S Thrfc*- 

[0144] f^^^SS!5 1 0 5 I*. *$MS35 1 0 4 (w J: 
y JC^LT. 10 8 iC^l^SttjfeiftSWiax^ h,u 



34403331 §|ffl#J • ^*Q#] 



25 

[0145] Z<d£ 5*^^-vB883SB(-<tixtf. 

is^x^y w-san 0 3i:j; DUjasaxfcfiittaT^y 

[0146] 021 ;fcJ;U^2 2 ^gggaSSei- 
[0 14 7] WS^* h/u^feEESBWa^^ h/u«r±* 

[0 1 4 8] iE!(S*IJgiJ»WCti. tf^r^y Sfc*;tfcj|X 

T\ ^tlh^o'hM® (M < N) h^&il^ 
Six-Si:, -t^Wa^^ h /u fc ^-S^* h^KDrt^Sr 

[0 14 9] r<0#W«fc-ete. ^x^y BB»«Sr*# < 

u ^o, ^^=f y < t-6 «fc b k> n&^, 

*Six5M*<offi«*!i— *tJKSix-6 0 :ixl:J; 9 „ 
&asf?fc>*x5 0 

[0 15 0] £/£##W-ei*. #^x=fy *s«s 
^H6ix5 J: p^^J*^^ :r =f y Sic 

ffi«ttt-r€>eSiJo«rfc*ffiBB*s**S^x. Xt*'** — 



(14) 10-289320 

26 

Tfi-g£*x6o 

[0151] r<B#WS:i;:J:ixtf, «F®^r^^^>ifiSL 
'>&< filiiofcS:^^^->'<o^JSiJ*Sfjcffl^e>*xT^ 

70 [0 15 2] W-btfcSB UfcHifte^ffitC*3^T, #ny^ 

7 fc'^gggt. ^-fXgRgiJBBft (Bayes discriminant fun 
ction ) , Xffi%m$k (Modified Bayes discr 

irainant function) §^ffl^Tt)J:t\ 

[0153] ::t\ ^h^g = (gi , g 2 > 

20 • , g n ) t^<# h/U p = ( p i , P2» • ' 

[0154] 
l»3] 

D cb (g> p) ~ 21 I g i - p i I 

1=1 

[0155] [^7/ fc'^ggpt] 
D m (g, p) = (g - p) T £ j _1 (g - p) 

::x% p(«^*T^y<ofS/^-y P i (i = 

^ 1 f 2, 3, • * ■ , N) <D¥*&T*£>*K 2j ^te&it 

Ij = (1/N) £ (Pi -p) (Pi -p) T 

Lj <D@*Tffl«:Ai , X 2 , • • -^n (^1 >^2 

> • • • > x n ) t U ^fS-T5@^-<^ b'l'&Ztl? 

tl<t> l , <f>2» • ' ' t <^n^^x 
(01 , 02» ' * * . 0 n ) 

t-f6ir. D ra (g, p) f*. i^^J: 9 ic^tt^o 
[0156] 

40 
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D m 2 (g.p) = (<P T (g-p)) T 



1/ -< , 



0 



0 
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<t> T (g-p) 



(U T (g- P )) 2 



[0157] [»|v/N7y tr^E«] 

[ 0 1 5 8 J 
IS&5] 

A. i = X (— j£) (m< < n , 

f (g) = (g-p) T Z _1 (g-p) + 1 n 1 £ 1 

XHSUHR (2#:«BiJB8S) fi-<^ h^g£-< 

[JJHR^ XNMiJBBft] 

[01 601 
[1*6] 

k (Oi T (g-p)} 2 

f «(g)« s 

{Oi T (g-p)} 2 



[0159] /:/:U 



i * k ♦ I 



k • 1 



+ ln ( rf 4 i ■ IT A x.i) 

1 = I i = k ♦ 1 

[0161] c<o»fil-<><XBW5iJB8»li, 
7/ tr^E«i^ai^v^XBj|iB»a*5ffto*t, **t&a*M 



40 



50 



m+ 1 < i ^ n) 

[0 16 2] #38Wf*. jC^s** — ><Dfyt£b 

[0163] 

[*«*>$&*] #3891fc:J:*itf. ttS<0/**- 
tci^TSS. «Mc, Bffl$MBE<a#»lwS»3ixfc 

1] *¥&w<v'<?->&^&w<v!%mmv&>z> 0 
2] KS:^i-ia-c*>So 

3] ^^y fc#BB»»ffllB«:»-rH-e*>S. 
4] m«l«8SB0«j&B-Cft><&. 
5] iRIi^-^/KOWiSSr^i-H-CfcSo 

H'6i sri o^-^tg»isa^»«ia"c«>eo 
9] 1 <Dmffi7 L -y/i'&7jk-fmx'&>z>o 

Ell 0] fR3<os<# — ^»SRJSH^»J*ia"efc6 0 

011] ^#»j*^h-h-c*>6o 

0 12] S2(D#ifip|S$BS:^titfcSo 

0i3] «3<7>#Ba»»fflPiB*^i"H-e*>5o 

0 14] S2 crj^ffix — 7/\<>%7jk-fmX~abZ> 0 

l 5] ^S^^-^Srfflt^fiHi^-y/^fiKftiS 
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